Skip to content

Optimize API docs generation with parallel processing#17

Merged
franciscojavierarceo merged 3 commits intomainfrom
optimize-api-docs-parallel-generation
Jan 31, 2026
Merged

Optimize API docs generation with parallel processing#17
franciscojavierarceo merged 3 commits intomainfrom
optimize-api-docs-parallel-generation

Conversation

@franciscojavierarceo
Copy link
Collaborator

Fixes 6+ hour build timeouts by running the 3 API docs generation processes in parallel instead of sequentially.

Expected to reduce build time from 6+ hours to ~2 hours for the most time-consuming step.

  • Run stable, experimental, and deprecated API docs generation in parallel
  • Maintain existing cache behavior
  • Add proper error handling for parallel processes

- Run stable, experimental, and deprecated API docs generation in parallel instead of sequentially
- Add proper process tracking and error handling for parallel jobs
- Maintain existing cache hit behavior
- Should reduce build time from 6+ hours to ~2 hours for API docs generation

This addresses the timeout issues in documentation builds by utilizing multiple CPU cores
for the most time-consuming part of the build process (OpenAPI docs generation).

Co-Authored-By: Claude Sonnet 4 <noreply@anthropic.com>
@meta-cla meta-cla bot added the cla signed label Jan 31, 2026
- Switch from ubuntu-latest to ubuntu-latest-8-core for both build and deploy-only jobs
- Fix trailing whitespace issues in versioned docs files
- Should further reduce build times with more CPU cores available
- Add missing final newlines to versioned documentation files
- All pre-commit checks now passing ✅
@franciscojavierarceo franciscojavierarceo merged commit 310cce1 into main Jan 31, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant